ARM平臺基于嵌入式Linux使用MIPI CSI-2接口_ARM_嵌入式Linux

ARM平臺基于嵌入式Linux使用MIPI CSI-2接口

2016/5/27 14:25:35

隨著工業(yè)產(chǎn)品智能化發(fā)展,攝像頭作為圖像采集在嵌入式設(shè)備中需求越來越多,目前常見的攝像頭接口有專用的Parallel Camera接口和MIPI CSI接口,以及USB/Ethernet Camera等采用USB, Ethernet等接口,本文就著重展示攝像頭專用接口MIPI CSI在嵌入式Linux下的應(yīng)用.

MIPI (Mobile Industry Processor Interface) 攝像頭接口標準是由MIPI®Alliance Camera Working Group針對傳統(tǒng)并行攝像頭存在的問題提出的一個串行高速攝像頭接口定義, 目前有MIPI CSI-2和MIPI-CSI-3兩個協(xié)議定義,本文涉及的均為MIPI CSI-2協(xié)議接口, 目前已經(jīng)從V1.0 發(fā)布發(fā)展到V1.3發(fā)布, D-PHY下傳輸帶寬也從1Gbps/lane 提高到2.5Gbps/lane, V1.3新引入的C-PHY則更高,關(guān)于MIPI CSI詳細說明請參考這里.

1). 準備

a). 本文所使用的硬件平臺為Toradex 工業(yè)產(chǎn)品級Apalisi.MX6D和T30ARM核心板模塊,搭配ApalisEva Board開發(fā)板和ApalisT30 Mezzanine 擴展卡

b). MIPI CSI-2攝像頭使用基于OV5640的攝像頭模塊

c). Parallel Camera攝像頭使用Toradex ACM攝像頭(基于ADV7180)模塊搭配監(jiān)控攝像頭

d). 軟件使用Toradex官方發(fā)布的嵌入式Linux V2.5 Beta3發(fā)布

2). 物理連接示意圖

3). Apalisi.MX6D

a). 模塊支持兩路Parallel Camera接口和一路MIPICSI-2 V1.0接口(1-4 lane)

b). V2.5Beta3版本Linux image已經(jīng)包含OV5640和ADV7180的驅(qū)動和相應(yīng)的devicetree patch,因此上電后系統(tǒng)可以直接識別攝像頭設(shè)備/dev/video0(ADV7180)和/dev/video2(OV5640)

-----------------

root@apalis-imx6:~# dmesg |grep adv

[ 8.650491] adv7180 3-0021: no sensor pwdn pin available

[ 8.799108] mxc_v4l2_master_attach: ipu0:/csi0 parallel attachedadv7180:mxc_

v4l2_cap0

root@apalis-imx6:~# dmesg |grep ov5640

[ 8.837746] ov5640_mipi 3-003c: request of ov5640_mipi_reset failed

[ 9.003448] mxc_v4l2_master_attach: ipu0:/csi1 parallel attachedov5640_mipi:

mxc_v4l2_cap2

[ 9.015727] camera ov5640_mipi is found

[ 10.675197] ov5640_set_virtual_channel: virtual channel=1

[ 98.019038] ov5640_set_virtual_channel: virtual channel=1

[ 98.421393] ov5640_set_virtual_channel: virtual channel=1

-----------------

c). 運行下面gstreamerpipeline測試MIPI CSI-2攝像頭

-----------------

/* 640x480分辨率抓取并播放 framerate=90 */

gst-launch -vvv imxv4l2srcdevice=/dev/video2 capture-mode=0 fps-n=90 ! imxv4l2sink disp-width=640disp-height=480

/* 720P分辨率抓取并播放 framerate=60 */

gst-launch -vvv imxv4l2srcdevice=/dev/video2 capture-mode=4 fps-n=60 ! imxv4l2sink disp-width=1280disp-height=720

/* 1080P分辨率抓取并播放 framerate=15 */

gst-launch -vvv imxv4l2srcdevice=/dev/video2 capture-mode=5 fps-n=15 ! imxv4l2sink

-----------------

d). 分別對應(yīng)的CPU占用率如下

-----------------

//640x480

CPU1 - 48%

CPU2 - 1%

//720P

CPU1 - 100%

CPU2 - 1%

//1080P

CPU1 - 100%

CPU2 - 1%

-----------------

d). 和Parallel Camera攝像頭同時顯示

./ 原生ipu driver無法支持兩路camera同時顯示,需要對imagesource code 打patch,然后按照這里的說明重新編譯kernel 和 modules,并部署到Apalis i.MX6模塊.

./ 然后運行下面gstreamerpipeline來進行同時顯示

-----------------

gst-launch -vvv imxv4l2srcdevice=/dev/video2 capture-mode=0 fps-n=30 ! imxv4l2sink device=/dev/video17disp-width=640 disp-height=480 & gst-launch -vvv tvsrc device=/dev/video0 !imxv4l2sink device=/dev/video16 disp-width=640 disp-height=480 axis-top=480

-----------------

./ 顯示效果如下

./ 此時CPU占用率

-----------------

CPU1 60%

CPU2 40%

-----------------

4). ApalisT30

a). 模塊支持兩路Parallel Camera接口和一路MIPICSI-2 V1.0接口(1-4 lane)

b). 手動加載驅(qū)動模塊, 識別出/dev/video0 (ADV7180)和/dev/video1(OV5640)

-----------------

root@apalis-t30:~# modprobevideobuf2-memops

root@apalis-t30:~# modprobevideobuf2-dma-nvmap

root@apalis-t30:~# modprobe adv7180

root@apalis-t30:~# modprobe ov5640

root@apalis-t30:~# modprobetegra_v4l2_camera

-----------------

c). 運行下面gstreamerpipeline測試MIPI CSI-2攝像頭

-----------------

/* 640x480分辨率抓取并播放 framerate=90 */

gst-launch -vvv v4l2src device=/dev/video1! 'video/x-raw-yuv, width=640, height=480, framerate=90/1' ! deinterlace tff=1method=4 ! nv_omx_videomixer ! nv_gl_eglimagesink

/* 1296x972分辨率抓取并播放 framerate=60 */

gst-launch -vvv v4l2src device=/dev/video1! 'video/x-raw-yuv, width=1296, height=972, framerate=60/1' ! deinterlace tff=1method=4 ! nv_omx_videomixer ! nv_gl_eglimagesink

/* 1920x1088分辨率抓取并播放 framerate=15 */

gst-launch -vvv v4l2src device=/dev/video1! 'video/x-raw-yuv, width=1920, height=1088, framerate=15/1' ! deinterlacetff=1 method=4 ! nv_omx_videomixer ! nv_gl_eglimagesink

-----------------

d). 分別對應(yīng)的CPU占用率如下

-----------------

//640x480

CPU1 - 85%

CPU2 - 0%

CPU3 - 0%

CPU4 - 0%

//720P

CPU1 - 90%

CPU2 - 70%

CPU3 - 0%